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Abstract 

Background: Improvement of traditional methods for dietary assessment is necessary, especially in rural areas 
where it is more difficult to succeed with self-reporting methods. This study presents and validates a method for 
improving accuracy when measuring food and nutrient intake of individuals in rural areas. It is called the "Food 
photography 24-h recall method" (FP 24-hR) and is a modified 24-h recall with the addition of a digital food 
photography record and a photo atlas. 

Methods: The study was carried out in a rural area in the tropical region of Bolivia; 45 women participated. 
Validation of the method was made by comparing it with a reference method, the Weighed Food Record (WFR). 
During the FP 24-hR, digital photographs were taken by the subjects of all food consumed during a day and a 24-h 
recall questionnaire was conducted by an interviewer. An estimate of the amount of food consumed was made 
using a photo atlas and the photographs taken by the subjects. For validation, comparison was made between the 
calculations, by both methods, of the levels of food, and nutrient, intake. 

Results: The comparison was made in 10 food categories; most of which were somewhat underestimated from 
-2.3% (cassava) to -6.8% (rice), except for beverages (+1.6%) and leafy vegetables (+8.7%), which were 
overestimated. Spearman's correlation coefficients were highly significant (rfrom 0.75 for eggs to 0.98 for potato 
and cassava). Nutrient intakes calculated with data from both methods showed small differences from -0.90% 
(vitamin C) to -5.98% (fat). Although all nutrients were somewhat underestimated, Pearson's coefficients are high 
(>0.93 for all) and statistically significant. Bland Altman analysis showed that differences between both methods 
were random and did not exhibit any systematic bias over levels of food and nutrient intake, with acceptable 95% 
limits of agreement. 

Conclusion: The FP 24-hR exhibits acceptable differences when compared with a WFR, digital photos are useful as 
a memory aid for the subjects during 24-h recall and as an estimation tool. The method is suitable for assessing 
dietary intake among rural populations in developing countries. 
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Background 

Nutritional assessment in many low-income countries 
emphasizes new simple, non-invasive approaches that 
can be used to measure the risk of both nutrient 
shortages and excesses, as well as to monitor and evalu- 
ate the effects of a nutrition intervention. One approach 
is to use the dietary assessment methods which can 
identify any nutritional deficiencies by measuring the 
food consumption of individuals [1]. 

In some rural populations in low-income countries a 
weighed food record, completed by trained research 
assistants in the households, has been used as the most 
precise method available for estimating the usual food 
and nutrient intake of individuals, because some subjects 
are not literate or cannot use the scales [2,3], in Bolivia, 
the illiteracy in rural areas is 37.9% for women with 
15 years or more, and 15.7% for men [4]. However, the 
method is time-consuming and expensive and the usual 
eating pattern of the respondents can easily be dis- 
rupted. Therefore the 24-h recall is being used widely to 
assess the dietary intake of individuals [5-7]; the method 
is quick and economical, it can be used equally well with 
both literate and illiterate subjects, and the respondent 
burden is small. Nevertheless, the success of the method 
depends on the subjects memory, the ability of the sub- 
ject to conduct accurate estimates of portion sizes con- 
sumed, and the persistence of the interviewer [1]. 
Furthermore, it has been reported that the 24-h recall 
applied as the sole method in rural populations resulted 
in a systematic negative bias that lead to significant 
underestimates of average daily energy and nutrient in- 
take compared with that obtained by the weighed record 
[8] as well as the misreporting of energy and micronu- 
trient intake [9]. 

All methods used to assess self-reported daily dietary 
intake have several limitations in terms of the accuracy 
of the portion size estimation [1,10]. To improve the ac- 
curacy of dietary assessment methods and overcome 
their limitations it is recommended to make the existing 
techniques more sensitive to community specifics by 
using multiple measurement methods [3], as there is a 
large variation from community to community with re- 
spect to staple foods, their preparation and dietary habits 
in general. One of the main errors to occur in the meas- 
urement of food consumption in dietary surveys is the 
assessment of portion sizes; therefore standard portions, 
household measures, food models and pictures are used 
as aids for the quantitative estimation of food in dietary 
data collection [11]. Food photographs depicted in stan- 
dardized portion sizes (small, medium and large portions 
which are meant to be representative of the range of 
portion sizes actually consumed), organized in a booklet 
or atlas have been shown to be helpful in improving the 
accuracy of food quantification [12-15]. 



As a new approach the inclusion of digital photo- 
graphs has been used to estimate portion size by taking 
photos of food and meals before and after consumption 
and by making food estimations either with the digital 
photographs alone or by comparing them with standard 
photographs. This method was validated mostly by com- 
paring it with weighed records (as a reference method). 
Studies have been conducted in a variety of settings such 
as schools, colleges, university cafeterias [16-18], labora- 
tories [19,20], hospitals or community centers [21,22], 
and in free-living conditions [20,23,24]. The results indi- 
cate that digital photographs are useful for assessing 
dietary intake in individuals, and for reducing the re- 
spondent burden associated with completing food records. 
To our knowledge, the use of digital photographs has not 
yet been validated or used in rural populations in low- 
income countries. 

The aim of the present study was to develop and validate 
a modified 24-h recall method with digital food photo- 
graphs as a tool for subjects to recall their intake, and a 
photo atlas with standard portion sizes of the foods com- 
monly consumed in the area to simplify the estimation of 
consumed portions. The validity of the method was 
assessed by comparing the results with a reference method 
WFR running in parallel. The modifications were made to 
adapt the food photographs for use among rural popula- 
tions in low-income countries where there may be a 
limited ability to read or write. The method developed 
is designed to be used in a further study for assessing 
the dietary intake of patients with leishmaniasis in the 
same area. 

Methods 

Subjects and study design 

Women aged 20-52 years, from a rural area named 
Eterazama, a tropical region located 180 km east of 
Cochabamba-Bolivia, participated. A nurse from the 
local health center visited women in their homes within 
a 0.5 and 3 km radius around the health center and 
invited them to participate. Their participation depended 
on their willingness to be followed closely for one day 
during the preparation and consumption of their meals. 

Figure 1 shows the design of the study. A modified 24-h 
recall method in 2 steps, so-called FP 24-hR was devel- 
oped. In the first step, digital photographs are taken by the 
subjects, of the foods they consume over a 24 hour period; 
in the second step, one day after, during an interview 
following a 24-h recall questionnaire, the subjects esti- 
mate and report the quantities of food consumed the 
day before. Their digital photographs help them to re- 
call all foods and also to estimate the portion size by 
comparing them with standard food photographs in a 
photo atlas. The FP 24-hR was validated with a refer- 
ence method, WFR, in which weighed amounts of the 



Lazarte et al. Nutrition Journal 201 2, 1 1:61 
http://www.nutritionj.eom/content/1 1/1/61 



Page 3 of 14 



Before the Study 



Preparation of 
the material: 
-24-h recall 
questionnaires 
-Photo Atlas 
-Photo kit 



Day before test day 




Test day, 45 subjects 




Day after test day 


► 




I 




, i , 




r 



Visit the subjects 
and explanation of 
the method 



Subjects receive 
Instruction and 
practice to use 
the photo kid 



Run in parallel: 
FP 24-hR and WFR 



FP24-hR 



I s Step: Subjects take 
photos of all meals 



WFR 



An assistant weighed and 
recorded all foods 
consumed by the subjects 





34 subjects completed WFR 



2 nQ Step: 24-h 
recall, estimation 
of portion size 
with digital 
photos and photo 
atlas 



45 subjects 
completed FP 24-hR 



Statistical analysis 
comparisons of 
food and nutrient 
intake calculated 
by both methods 



Figure 1 Design of the study: Validation of the developed method FP 24-hR by comparing it with WFR. 



food consumed were recorded by assistants in the sub- 
ject's home. The two methods were run in parallel during 
a test day. 

The Ethics Committee of the Faculty of Medicine at 
Lund University approved the study. 

24-h recall questionnaire 

A 24-h recall questionnaire was elaborated according to 
guidelines given in Gibson (2005), and pre-tested with 
respondents in the area in question in order to ensure 
that the questions were relevant and understandable. 
The questionnaire has questions about the name of the 
foods and meals consumed, whether food intake was 
normal that day, and if there was any consumption of 
medicines or vitamin-mineral supplements; also, place 
and time of consumption are listed for: breakfast, mid- 
morning snack, lunch, mid-afternoon snack and dinner. 

Photo atlas 

A photo atlas with color photographs of 78 common 
foods consumed in the area, in various portion sizes, 
was included to assist the interviewer and participants in 
estimating the sizes of the portions. A total of 334 pho- 
tos, divided into 8 food groups, that is meat, cereals, 
legumes, tubers, vegetables, fruits, composite meals and 
drinks, are depicted in the atlas. 

To prepare the photo atlas, we used population-based 
data as suggested by Nelson and Haraldsdottir (1998). 
Nutritionists visited families in the area of intervention 
to acquire some knowledge of the most commonly con- 
sumed foods, the portion sizes and the tableware used. 
This information was collected in an open questionnaire 



and used to design the album in terms of the number of 
items, the number of portion sizes and the kind of plates 
on which the food should be photographed. 

The photographs of the food in the photo atlas were 
taken at approximately the same angle of 90° and dis- 
tance of 50 cm, above the plate. A second photograph, 
with an approximately 45° angle, used to show differ- 
ences between portion sizes depending on the height of 
the food on a flat plate and depth in a soup plate, was 
taken when necessary. The plates were placed on a table 
mat with 1.5 cm grids marked out. It was deemed useful 
to keep a standard background for the photographs. 
Additionally, reference objects of a spoon, fork or knife 
were placed next to the dish to provide some idea of 
scale of the dish size. 

The foods were depicted in different portion sizes 
from 3 to 7 judged to be representative of the range of 
portion sizes actually consumed, placed on 2 different 
types of plates, flat and soup plates, common in the area. 
The portions were arranged in descending order with 
the biggest portion on the top. The name (in Spanish) 
and weight of the food is shown on the top of each photo- 
graph, the images were color prints in size 75 x 60 mm 
allowing eight photos to be displayed together on one 
A4 page. Figure 2 shows an example of photographs 
from the photo atlas. Additionally the photo atlas pre- 
sents depicted raw ingredients (like tomatoes, onion, 
etc.) in different standardized sizes from 3 to 5 depend- 
ing on the variety of actual sizes existing on the market, 
these photographs were useful when the subjects were 
describing the individual food items in mixed dishes 
such as soups, stews, etc. 
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*Fideo macarron: FIG. Ce 31 (400/130g) 



Carnederes, asado: FIG. Ca 1 (lllg) 




Figure 2 Example of photographs from the photo atlas shows portion sizes of cooked and raw food. ^Example of cooked food in 
different dishes and from different angles: the name of the food (in Spanish) and weight of the portion is shown on the top of each photograph. 
In cases where there is a change in the weight during cooking, both weights are shown (weight of cooked food/weight of raw food). 
^Example of raw food, the weight of the individual food is shown inside the photographs. 



Photo kit 

A photo kit (Figure 3) to be used by the subjects for taking 
photographs of all their foods consumed during the test 
day was prepared, containing: a digital camera (Samsung 



Digimax S760, LCD screen 2.4 in) a camera case and a 
table mat. The table mat to put the plate on is marked 
with 1.5 cm grids providing a standard background, equal 
to that used in the photo atlas. 
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Food photographs as a tool in 24-h dietary recall: 
FP 24-hR 

The day before a test day a nurse, a nutritionist and an 
interviewer visited the women one by one in their homes 
and explained verbally the procedure of the study. When a 
woman voluntarily accepted to participate, she received 
verbal instructions, was given a demonstration and allowed 
to practice taking adequate photographs of her meals with 
easy-to-understand instructions. 

As a first step, the subjects took photographs of all 
their meals consumed during the test day with the fol- 
lowing instructions: Place the plate with the food on the 
table mat, take two photographs before eating and two 
photographs after finishing if there are leftovers, one 
photograph at 90°, approximately 50 cm straight above 
the plate (hold the camera at a sufficient distance to see 
the whole marked table mat in the entire frame of cam- 
era screen and shoot, the size of the table mat was stan- 
dardized to give -50 cm distance in this position), and a 
second photograph with an approximate angle of 45° 
(take one step back from your original position fit the 
camera screen to cover the entire table mat and shoot). 
Both photographs are meant to span characteristics of 



appearance which are likely to influence perception of 
amounts from photographs, these characteristics are: 
area and height of pieces, mounds on a flat plate and 
depth in a soup plate, useful for a better estimation of 
the food portion sizes. Compliance with the method was 
good; 47 women were asked to participate, of which 45 
(96%) accepted, they all took the photographs requested. 
Figure 4 shows the photographs taken by a subject dur- 
ing the test day showing breakfast, lunch (from two dif- 
ferent angles) and dinner. 

On the following day, as a second step, a trained inter- 
viewer (not the assistant who kept the weighed food record) 
asked the subject to recall the exact food intake during 
the preceding day, according to a four-stage, multiple- 
pass interviewing technique [1]. 

The multiple-pass 24-hr recall was conducted as 
described in Gibson, (2005) with small modifications 
in the third pass, to estimate the amount of food and 
beverages consumed; during this pass, the subjects are 
to be asked to estimate the amount of food consumed; 
comparing the digital photographs they took on the 
test day with photographs of standard portion size in 
the photo atlas. At the same time the interviewer is to 
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make her/his own comparison of the photographs and 
ascertain or correct the portion size selected. The sub- 
jects are also to be asked to describe some hidden 
foods which are not visible in the digital photographs. 

Reference method: WFR 

The WFR, was run in parallel with the FP 24-hR. An 
assistant, who had previously been trained by a nutri- 
tionist, visited each subject during the preparation and 
consumption of her meals during the test day. 

Before consumption of the meals, the amount of each 
food item and beverage was transferred to a clean dish, 
weighed (Ohaus Traveler TA 1501, capacity 1500 ±0.1 g), 
and recorded separately, the same procedure was follow 
after consumption if there were leftovers, and the actual 
amount of each type of food eaten was subsequently cal- 
culated subtracting leftovers. In the case of mixed meals 
such as soups or stews, raw ingredients used in their prep- 
aration, were weighed (±0.1 g) and recorded individually, 
the final total weight of the mixed dish was weighed in the 
cooking pot, using a second scale with greater capacity 
(Ohaus Valor™ 1000 V11P30, capacity 30 kg ±5 g), also 
the individual served dish was weighed (±0.1 g) and 
recorded. The weight of each ingredient was calculated for 
individual consumption. 

Anthropometric measurements 

Measurements of height and weight were performed by 
trained staff, using a digital electronic scale (Omron HBF- 
400), 150 kg ±0.1 kg and a portable stadiometer ±1 mm. 
The subjects were lightly dressed and without shoes, when 
the measurements were taken, body mass index (BMI = 
weight [kg] /height [m 2 ]) was calculated and evaluated 
using the World Health Organization classification 
[25,26]. 

Food intake and Nutrient calculation 

A data base for nutrient calculation was elaborated in an 
excel file for most items with data from USDA National 
Nutrient Data Base for standard reference [27]. For a 
few items the Bolivian Food Composition Table was 
consulted [28]. The elaborated database contains 141 



food items properly encoded. We chose to use the 
USDA reference database due to a lack of information in 
the Bolivian table about cooked food. 

The data of food intake of the subjects was extracted 
from questionnaires (FP 24-hR) and records (WFR) of 
the 45 subjects who participated in the validation. The 
data were divided into 10 categories of food for compar- 
ing weighed and estimated amounts. The selected food 
categories reflect the composition of the diet pattern in 
this population as well as representing the source of cer- 
tain nutrients of interest. The bread, rice and noodles 
category represents the staple cereal-based food. Pota- 
toes and cassava are tubers mainly consumed in the 
area. Eggs and meat represent the main protein sources 
of their diet. Vegetables category was divided into leafy 
vegetables (spinach, lettuce, etc.) and vegetables (toma- 
toes, carrots, etc.), because leafy vegetables may be more 
difficult to estimate due to the volume they occupy does 
not represent their actual weight. And finally the cat- 
egory of beverages was added to evaluate the estimation 
of liquids. 

All dietary information from WFR and FP 24-hR was 
coded according to the food code in the database. Food 
codes and amounts were entered into the excel files in 
order to compute the total amount consumed per day 
and the average daily energy and nutrient intake. The 
method has been validated with respect to actual in- 
take of energy, protein, total fat, carbohydrates, dietary 
fiber, calcium, iron, zinc, selenium, folate, thiamin, nia- 
cin, (3-carotenoids, and vitamins C, A and E. The 
macronutrients and fiber were selected because they 
are commonly requested in diet studies. The minerals 
and vitamins were selected according to their relevance 
to elucidate deficiencies present especially among rural 
populations in developing countries, and according to 
their different sources (i.e. folate, vitamins C, are 
mainly in vegetables; thiamin, niacin are mainly in 
cereal products, etc.). 

Statistical analysis 

Normality of distribution of data was assessed by the 
Kolmogorov-Smirnov test and by visual inspection of 
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histograms with reference to measures of skew and kur- 
tosis. Logarithmic transformations were used, when appro- 
priate, to normalize the data (food categories). The 
amounts of estimated food categories and calculated nutri- 
ent intake are reported at group level using medians and 
percentiles 25 th , 75 th (for not normal distributed data) and 
means and standard errors (for normal distributed data). 

To test the validity of the FP 24-hR, the mean or me- 
dian difference in grams and percent of the intake be- 
tween mean amounts actually eaten (WFR), and mean 
amounts estimated (FP 24-hR) were calculated and 
expressed at the category level. A negative difference is 
considered to indicate an underestimation of the 
weighed serving. The differences between amounts in 
portion sizes of food categories weighed and estimated 
were tested using Wilcoxon signed rank test (not normal 
distributed data) and differences between nutrient 
intakes estimated by FP 24-hR and WFR were tested 
using paired £-test (normal distributed data). 

Pearsons or Spearman's rank correlation coefficients 
were calculated to assess the association between the 
weighed and estimated amount of food and between nu- 
trient intakes assessed by both methods. 

Agreement between both methods was assessed using 
the Bland- Altman regression; the mean differences of food 
amounts and nutrient intakes between both methods were 
plotted against its average value, and the 95% limits of 
agreement were marked. This kind of plot shows the mag- 
nitude of disagreement, allows outliers to be spotted and 
any trends to be identified; desirable agreement between 
the two methods would result in a difference of zero. 

For all statistical tests the significance level was set up at 
P < 0.05; and the tests were carried out using SPSS version 
18.0 (SPSS Inc., IBM corporation 2010, www.spss.com). 

Results 

All the 45 subjects (100%) successfully completed the FP 
24-hR. As 11 women had one of their meals (mid-after- 
noon snack or dinner) outside their home, complete data of 
WRF was available for 34 women (76%). The comparisons 
of food amounts estimated vs. weighed were made with the 
mean portions for each type of food from meals consumed 
at home for all 45 subjects. Comparison of nutrient intake 
calculated by both methods was analyzed for 34 subjects. 

The subjects' characteristics are presented in Table 1; 
the women aged 20 to 52, mean BMI 24.82 kg/m 2 . Fifty 
six percent were in the range of normal BMI values, 
while some of the women were underweight (7%), over- 
weight (26%) and obese (11%). 

Comparison of food categories estimated vs. weighed 
amount 

The data of food groups were not normally distributed; 
therefore the accuracy of the FP 24-hR method is 



Table 1 Characteristics of subjects 





Mean 


Wnmpn In — 

VVUIMCII \ll — "J/ 

SD 


% (n) 


Age [years] 


35 


8.6 




Height [cm] 


155.55 


6.84 




Weight [kg] 


59.76 


8.70 




BMI a [kg/m 2 ] 


24.82 


4.06 


100 (43) 


Underweight 


18.40 


0.12 


7(3) 


Normal weight 


22.80 


1.64 


56 (24) 


Overweight (Pre-obese) 


27.31 


1.64 


26(11) 


Overweight (Obese classl) 


32.79 


1.61 


11 (5) 



a BMI [kg/m 2 ], body mass index, classification according WHO [24]; 
underweight (<18.5), normal weight (18.50-24.99), pre-obese (25.00-29.99), 
obese class I (30.00-34.99). 



presented for the foods listed as median values and per- 
centiles (25 th , 75 th ) of the amounts estimated in the 
questionnaires and the corresponding information of 
weighed food amounts recorded by assistants with WFR. 
This comparison was done for 10 major food categories: 
bread (n = 26), rice (n = 43), noodles (n = 43), potatoes 
(n = 80), cassava (n = 19), meat (n = 48), egg (n = 15), 
vegetables (n = 198), leafy vegetables (n = 17), and bev- 
erages (tea, milk or refreshments) (n = 19). The median 
amounts and percentiles (25 th , 75 th ) of food estimated 
(FP 24-hR) and weighed (WFR) respectively are pre- 
sented in Table 2 as well as the differences between the 
medians (in grams and percentage, respectively), and the 
percentiles of the differences are shown. 

Most of the food categories were underestimated (ran- 
ging from -2.3% for cassava to -6.8% for rice), excepting 
for beverages (+1.6%) and leafy vegetables (+8.7%) which 
were somewhat overestimated. Data were analyzed with 
non-parametric tests; Wilcoxon signed rank test showed 
that the differences between estimated and weighed food 
are not significant (P > 0.05) except for rice (<0.001), pota- 
toes (0.032), egg (0.030) and vegetables (0.039). Spearman s 
correlations were calculated to determine the association 
at the individual level between the estimated amount and 
the actual weighed amount; all the food categories present 
a significant high correlation (r values from 0.75 for egg to 
0.98 for potatoes and cassava). 

The agreement between the estimated and weighed 
amount was assessed by Bland Altman analysis of the 
log-transformed data, because they were not normally 
distributed, as shown in Figure 5 (for meat, noodles, 
potatoes and vegetables). The plots for the differences 
of food amounts, estimated (FP 24-hR) and weighed 
(WFR), show that most of the differences are between 
the limits of agreement at mean ± 2 SD, showing only a 
few outliers (from 0% for leafy vegetables and beverages 
to 8.3% for meat). 
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Table 2 Amount of food estimated by FP 24-hR and compared with amount weighed in WFR 



FOOD CATEGORY 


(n) 


FP 24-hR 


WR 


Sperman r 


Median difference 
FP24hR - WFR a 


Bland Altman Analysis 
FP24hR - WFR (antilog) b 






Median (P25, P75) 


Median (P25, P75) 




Median (P25, P75) 


% 


Geometric 
mean ratio 


95% Limits of 
agreement 


Bread [g] 


26 


55 (50, 60) 


55 (47, 65) 


0.81 


-1.5 (-4.3,3.0) 


-2.43 


0.98 


0.79 


1.22 


Rice [g] 


43 


165 (105, 200) 


165 (108, 237) 


0.95 


-13.0 (-30.0,5.0) 


-6.76 


0.93 


0.71 


1.20 


Noodles [g] 


43 


175 (154, 256) 


187 (150, 263) 


0.93 


-12.0 (-20.0, 9.0) 


-5.41 


0.97 


0.73 


1.28 


Potatoes [g] 


80 


114 (61, 160) 


115 (71, 168) 


0.98 


-5.0 (-10.0, 7.8) 


-5.80 


0.96 


0.79 


1.18 


Cassava [g] 


19 


117 (64, 156) 


108 (66, 143) 


0.98 


-1.0 (-8.0, 8.0) 


-2.33 


0.99 


0.80 


1.22 


Meat [g] 


48 


36 (25, 51) 


34 (26,49) 


0.96 


-2.0 (-4.0, 2.0) 


-4.88 


0.95 


0.71 


1.28 


Egg [g] 


15 


50(50, 50) 


54 (46, 57) 


0.75 


-3.0 (-7.0,-1.0) 


-6.54 


0.94 


0.76 


1.17 


Vegetables [g] 


198 


25 (13, 43) 


25 (14, 43) 


0.96 


-1.0 (-4.0, 2.0) 


-5.44 


0.98 


0.65 


1.43 


Leafy vegetables [g] 


17 


25 (25, 50) 


27 (20, 46) 


0.90 


2.0 (-5.0, 7.0) 


8.70 


1.09 


0.70 


1.69 


Beverages [g] 


19 


250 (200, 325) 


260 (210, 310) 


0.95 


4.0 (-10.0, 10.0) 


1.63 


1.01 


0.93 


1.10 



a Median difference between FP 24-hR and WFR, in grams with 25 th , 75 th percentiles for the difference of each food category, and median of percentage 
percentage of the difference in parenthesis (calculated as: % of the difference = ((amount from FP 24hR- amount from WFR) / mean amount from WFR)*100). 
b Bland Altman analysis, show the antilog values of the mean difference between FP 24-hR and WFR, represented as the geometric mean ratio of amounts 
estimated by the FP 24-hR and weighed by WFR, and the 95% limits of agreement, represent the range of proportional agreement between both methods. 



For all the food categories the results from Bland 
Altman analysis were back-transformed and are pre- 
sented in Table 2, showing the geometric mean ratio 
of values by estimated and weighed food amount and 
the 95% limits of agreement. The geometric mean 
ratios are close to 1 and limits of agreement are nar- 
row for most of the food categories. For beverages 
the geometric ratio is 1.01 and narrow limits of 
agreement (0.93 to 1.10), for leafy vegetables the geo- 
metric ratio is 0.98 with relatively broad limits of 
agreement (0.65 to 1.43). 

Comparison of nutrient intake calculated from FP 24-hR 
and WFR 

The mean amount of nutrient intake from food con- 
sumption assessed by FP 24-hR and WFR respectively 
were calculated for energy, protein, total fat, carbohy- 
drates, dietary fiber, calcium, iron, zinc, selenium, thiamin, 
niacin, folate, (3-carotenoids, and vitamins C, A and E . 

The data follow normal distribution and thus parametric 
tests were used for the analysis. The results of mean nutri- 
ent intake and standard errors are shown in Table 3 as 
well as the differences between means (in the corre- 
sponding units for each nutrient and in percentage) are 
presented. The differences are in the range of -0.90% 
(for Vitamin C) and -5.98% (for total fat), indicating 
that both methods are comparable, with small differ- 
ences. All nutrient intakes were somewhat underesti- 
mated using the FP 24-hR method. Even though most 
of the differences are small they are statistically significant 
(paired £-test P < 0.05) except for calcium (P = 0.098), 



vitamin C (P = 0.528), vitamin A (P = 0.218) and (3- 
carotenoids (P = 0.565). 

Significant correlation coefficients (Pearson) between 
all nutrient intakes estimated by the FP 24-hR and the 
WFR were obtained (r value from 0.96 to 0.99) indicat- 
ing good association between both methods for all the 
nutrients. 

In order to assess the agreement between the methods, 
for all nutrients, Bland Altman analysis was performed 
as shown in Figure 6 (for energy, calcium, vitamin C, 
and iron). Plots for each nutrient show a few outliers 
(from 0% for energy to 8.8% for calcium), the majority of 
the measurements were scattered along the equality line. 
The plots thus showed fairly good agreement between 
the two methods and also indicated that the differences 
(including the outliers) were random and did not exhibit 
any systematic bias. 

In Table 3 the mean difference between the methods 
and 95% limits of agreement for the differences are pre- 
sented in the corresponding units for each nutrient and 
in percentage; showing small differences from -0.90% 
(for vitamin C) to -5.98% (for total fat) and narrow 
limits of agreement for energy (-11.5 to 3.5%) and car- 
bohydrates (-12.8 to 6.2%) and relatively broad but still 
acceptable limits are shown for p-carotenoids (-25.9 to 
25.4%) and vitamin A (-22.9 to 11.8%). 

Discussion 

The data analyses of individual food categories show that 
the FP 24-hR with digital photographs and a photo atlas 
was able to estimate the weights of food portion sizes 
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adequately and gave results comparable to the actual 
consumed amounts recorded by the WFR. The modifi- 
cations with digital photographs and a photo atlas added 
to the ability of the 24-h recall to minimize errors asso- 
ciated with the estimation of portion sizes, as well as the 
reduction of respondent burden. Therefore FP 24-hR 
represents a good alternative to the gold standard 
method (weighed food record) for estimating individual 
nutrient intakes, as it is demonstrated by the presented 
results. 



Furthermore, recent studies show that the introduc- 
tion of digital photographs taken by the subjects as a 
diet assessment method helps to estimate food intake 
and plate waste and this can reduce over and underesti- 
mates. This has been shown with children in cafeteria 
settings [17,20], with children at home [24,29], adults 
with intellectual disabilities living in the community 
[21], obese patients in hospital [22], as well as in college 
and university environments [16,18]. However, only a 
few studies have used digital photographs to estimate 
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Table 3 Mean nutrient intake and comparison of the results obtained with the methods: FP 24-hR and WFR 



NUTRIENT 

IN \J 1 111 l_ IN 1 


FP 24-hR 


WFR 




r ceil jui i 


Mean 
difference 
FP24hR - 

WFR a 


95% Limits of agreement 




Mean 


SEM 


Mean 


SEM 


r 






Energy [kJ] 


5854 


262 


6092 


261 


0.99 


-238 ( 


-3.99) 


-683 (-11.5) 


206 (3.5) 


Protein [g] 


46.70 


2.23 


48.95 


2.33 


0.99 


-2.25 ( 


-4.66) 


-6.93 (-14.5) 


2.43 (5.1) 


Total fat [g] 


23.59 


1.12 


25.09 


1.12 


0.96 


-1.50 


(-6.0) 


-5.34 (-21.9) 


2.34 (9.6) 


Carbohydrate [g] 


251 


14 


260 


14 


0.99 


-8.45 


(-3.2) 


-32.66 (-12.8) 


15.8 (6.2) 


Dietary fiber [g] 


15.6 


1.0 


16.2 


1.1 


0.99 


-0.63 


(-3.7) 


-2.5 (-15.8) 


1 .6 (7.9) 


Calcium [mg] 


254 


26 


260 


25 


0.99 


-6.20 


(-2.4) 


-48.1 (-18.7) 


35.7 (13.9) 


Iron [mg] 


11.22 


0.47 


11.82 


0.44 


0.97 


-0.60 


(-5.1) 


-1.92 (-16.7) 


0.72 (6.3) 


Zinc [mg] 


6.54 


0.30 


6.91 


0.30 


0.98 


-0.37 


(-5.4) 


-1.13 (-16.8) 


0.38 (5.7) 


Qplppiji ippi [i in;] 

-JCTICTI IIUI 1 1 |_W^JJ 


89.2 


6.2 


92.8 


6.7 


0.98 


-3.55 


(-3.8) 


-19.2 (-21.1) 


12.1 (13.3) 


Vitamin C [mg] 


65.1 


7.1 


65.7 


7.25 


0.99 


-0.59 


(-0.9) 


-11.4 (-17.4) 


10.2 (15.6) 


Thiamin [mg] 


0.78 


0.05 


0.81 


0.05 


0.98 


-0.03 


H.0) 


-0.14 (-17.6) 


0.08 (10.1) 


Niacin [ug] 


11.98 


0.55 


12.58 


0.57 


0.97 


-0.60 


H.7) 


-2.15 (-17.5) 


0.96 (7.8) 


Folate total [ug] 


177 


13 


185 


13 


0.98 


-8.44 


H.6) 


-37.5 (-20.7) 


20.6(11.4) 


(3-Carotenoids [ug] 


3087 


428 


3126 


462 


0.99 


-39.6 


(-1.3) 


-804 (-25.9) 


787 (25.4) 


Vitamin A [ug RE] 


378 


43 


387 


39 


0.99 


-8.31 


(-2.1) 


-85.4 (-22.3) 


68.8 (18.0) 


Vitamin E [mg] 


2.44 


0.15 


2.50 


0.14 


0.97 


-0.13 


(-5.4) 


-0.56 (-22.9) 


0.29 (11.8) 



a Mean difference between FP 24-hR and WFR, expressed in the corresponding units for each nutrient and percentage in parenthesis. The percentage was 
calculated as: % of the mean difference = ((mean nutrient from FP 24hR- mean nutrient from WFR) / mean nutrient from FWR)*100. 

b 95% limits of agreement for the difference between the FP 24-hR and WFR, in the corresponding units for each nutrient and percentage in parenthesis, show 
the range of under and over-estimation for the agreement between both methods. 



intake in free-living conditions [20] and with general 
populations [23]. Besides, to our knowledge this may be 
the first study using photographs to assess nutrient 
intake in rural populations in low-income countries. 

Studies comparing food estimates from digital photo- 
graphs and weighed records have found that the use of 
digital photographs results in small differences in the 
amount of food, in the range of -9.1 g to 18.3 g [16], 
and an underestimation of -6.6% for energy intake [20], 
although these differences are very small it has been 
reported that these underestimations were significantly 
different from the values obtained by the weighed record 
method. In the present study the comparison of the food 
amount evaluated by FP 24-hR and WFR has shown 
mean differences from -14.4 g to 4.5 g between the 
different food categories, where the differences were 
not statistically significant, excepting for some food 
categories (rice, potatoes, eggs, vegetables). 

In the analysis of nutrient intake energy was underesti- 
mated by -3.92% and the underestimations are in the 
range of -0.90% for vitamin C to -5.98% for total fat. 
These underestimations were significant excepting for 
certain nutrients (calcium, vitamin A, C, and (3-carote- 
noids). The significant differences found even when FP 
24-hR and WFR have identical mean, may be due to the 
variance within each group owing to the high variability 
among individual food consumption (i.e. portion size of 



rice consumption varies from 44 g to 400 g between 
subjects), which is subsequently reflected in significant 
differences in nutrient intake. The small underestimation 
of most of the food groups and all the nutrients may be 
due to some hidden foods in the photographs making it 
difficult to estimate portion sizes, and failure in memory 
of the respondents to identify all the hidden foods in the 
photographs. 

Notwithstanding the significant differences, the FP 24-hR 
showed high correlation coefficients in estimating por- 
tion sizes, in the range of 0.75 (for egg) to 0.98 (for 
potatoes and cassava), comparable to those reported in 
previous studies (>0.74) [12,15,19], where a photo atlas 
was used as a tool for quantifying portion size. 

Moreover correlations between photographic food record 
and weighed dietary record, for energy intake, reported 
by previous authors were as high as: from 0.93 to 0.95 
[20], 0.84 [30], from 0.44 to 0.48 [31], 0.73 [24], 0.79 
[18] and 0.60 [32], The correlation coefficient for energy 
intake reported in this study is 0.99. A few studies have 
reported correlation coefficients for macro and micronu- 
trients; for protein 0.83, 0.48, and 0.61; for carbohydrates 
0.55, 0.52 and 0.68; for fat 0.82, 0.46 and 0.50 were 
reported respectively by [24,31,32], the FP 24-hR found 
correlation of 0.99, 0.99 and 0.96 for protein, carbohy- 
drates and fat respectively. Correlation for vitamins are 
reported in the range of 0.06 to 0.80 [31] and 0.30 to 0.86 
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Figure 6 Bland Altman plots for nutrient intakes calculated from FP 24-hR and WFR. Differences between the mean dietary intakes of 
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and WFR; the dotted lines show the 95% limits of agreement for the differences, a) Plot for energy intake, b) Plot for calcium intake, c) Plot for 
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[32], correlation for minerals from 034 to 0.57 [31], and 
from 0.21 to 0.74 [32], the present study reports correla- 
tions for vitamins and minerals in the range from 0.97 
to 0.99. 

The results found with the Bland Altman analysis 
showed that the majority of the measurements 95.2% for 
food categories and nutrient intake, were scattered along 
the mean difference line and close to the equality line 
(difference = 0). The plots thus show fairly good agree- 
ment between estimated and actual food consumed and 
indicate that the differences (including the outliers) were 
random and did not exhibit any systematic bias, being 



consistent over different levels of mean food amount. 
Results were similar to previous studies, which have 
reported that the bias between the use of digital photo- 
graphs and weighed food records was consistent over 
different levels of energy intake, indicating that the two 
methods were comparable, and bias was very low [16,20]. 

In the analysis of food categories, the geometric mean 
ratios are close to 1 (from 0.93 for rice to 1.09 for leafy 
vegetables), and limits of agreement are narrow for most 
of the food categories. The ratios of proportional agree- 
ment indicate that for about 95% of the cases the esti- 
mated amounts will be between the values of the ratio 
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respect to the weighed amount, for example for bread 
the geometric mean is 0.98 with limits of agreement 
from 0.79 to 1.22; thus FP 24-hR when is compared with 
WFR gives values by between 0.79 to 1.22 times the 
weighed amount of bread. The limits of agreement are 
relatively broad for vegetables (0.65 to 1.43) and leafy 
vegetables (0.70 to 1.69); this may be because the disper- 
sion of the values in these two food categories increases 
as the weight increases. 

The analysis of nutrient intake showed that the mean 
differences between FP 24-hR and WFR were low and 
the limits of agreement acceptable, for example the aver- 
age energy intake estimated by the FP 24-hR was 5854 
KJ, the mean difference when it was compared to WFR 
was -3.92% and the limits of agreement were from an 
under-estimate of -11.5% to an over-estimate of 3.5%, 
most of the nutrients showed similar narrow limits of 
agreement. The widest limits of agreement resulted for 
the intake of p-carotenoids which presented a small 
mean difference -1.27%, but the wide limits of agree- 
ment from an under-estimate of -25.9% to an over- 
estimate of 25.4%, similar for vitamin A. In spite of this, 
the limits are in an acceptable range to guarantee that 
the FP 24-hR can be used in place of the WFR for all the 
nutrients presented. 

The small differences, high correlations and good 
agreement of the FP 24-hR with the WFR, may be be- 
cause the food patterns in the study area are simple and 
less diversified than in urban populations where the food 
availability is wider and includes more processed food 
ready-to-eat, which might be more complicated to evalu- 
ate, in addition the use of digital photos and a 24-h recall 
questionnaire carried out by an interviewer make possible 
for the respondents to describe the hidden foods in the 
photographs or describe poor quality photographs, thus 
obtaining the most complete data possible. At the same 
time the volunteers were motivated with the FP 24-hR 
which involves the use of a simple but interesting and new 
device like a digital camera, because rural populations 
in developing countries are not so familiar with digital 
cameras. Another important factor that could enhance 
compliance with the method is that it is simple and 
fast, demands less than 2 minutes to take two pictures 
of each meal, which implies a maximum investment of 
10 minutes per day to take digital photos of food 
consumption. 

Very limited data are available about food and nutrient 
intake in rural areas in Bolivia. In this study we found an 
apparently low daily energy intake: mean 5.9 MJ, from 
3.6 to 9.8 MJ in women 35 ± 8.6 years old. However, 
similar low energy intake for women in rural areas in 
South America has been reported previously, using 
different methods for measuring food consumption. In 
a study conducted in Calchaqui - Argentina, a 24-h recall 



and a semi-quantitative food-frequency questionnaire 
were applied and energy intake was estimated to be 
6.6 MJ [33] in women 43 ± 15.2 years. Furthermore, in 
Ura Ayllu, Peru, low energy intake such as 5.3 to 7.5 MJ 
was reported by the weighed food record method in 
women 31 ± 6.3 years [34]. Also in a study using multiple 
pass 24-h recall in a Mexican population the energy intake 
was 5.9 MJ in women 32 ± 0.3 years [35]. 

The common food pattern in the currently studied 
population is based mainly on carbohydrates like: tubers 
(potatoes, cassava) and cereals (rice, bread, pasta); 
accompanied by small portions of protein from eggs 
or meat (mainly beef and chicken); oil or tallow as sources 
of fat, and a few vegetables and fruits. The composition of 
macronutrients as a percentage of total energy reflects 
the food pattern, in total carbohydrates 72 E%, pro- 
tein 13 E%, and total fat 15 E%. The macronutrients 
consumption of the study group is within the dietary 
recommendation from the World Health Organization 
(Total carbohydrates 55-75 E%, protein 10-15 E%, and 
total fat 15-30%) [36]. However, the carbohydrates intake 
is nearly in the upper limit and the fat intake is nearly in 
the lower limit. 

Despite the lower energy intake, 56% of the women 
had normal BMI (22.80 ± 1.64), 26% and 11% respect- 
ively were overweight or obese, and only 7% were under- 
weight. These results are comparable to those found in 
rural areas with low energy intake such as in an study in 
Calchaqui- Argentina, which reported 39% of the women 
presenting normal weight [33]. 

A possible limitation in this study might be the undi- 
versified food patterns of the population under study; 
the photo atlas was designed and developed in accord- 
ance of the specific food patterns in the area, as the 
method is aimed to be used in further studies of dietary 
assessment in the same area, another limitation is the 
relatively small number of the volunteers. 

On the other hand the strengths of the study are: it 
was performed under the normal living conditions with- 
out disruption of the eating behavior, therefore the food 
consumed was representative of their habitual diet, and 
the inclusion of a digital camera which is a simple but 
interesting device for rural populations in developing 
countries may enhance the compliance with the method, 
and it may be used equally by both genders. 

Conclusions 

Assessing the dietary intake in rural communities in 
developing countries is more complicated because the 
individuals are often illiterate, and not able to keep their 
own food records or use scales in a proper way in order 
to weigh consumed food. Other obstacles may be that 
they are busy working on farms, which leads to less 
spare time over for carrying out demanding dietary 
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assessment methods or self-report methods. Besides it is 
well known that when keeping a weighed food diary 
there is always a risk that the subject will alter his 
normal diet, while with the interview method it is easier 
for the subject to make an incorrect statement about his 
food habits together with the difficulties in correct 
portion sizes estimation [10]. 

Thus, in order to reduce some of these drawbacks of 
the traditional methods used to assess the diet in rural 
populations, a FP 24-hR method is proposed and 
described, incorporating digital photographs taken by 
the subjects. This procedure is easier, faster, and less 
expensive to use than the WFR method, and it is less 
invasive; thus compliance may be enhanced. Further- 
more the incorporation of a photo atlas facilitates and 
improves the important task of estimating portion sizes. 

The validity of the method was assessed by several 
parameters. Firstly, the median and mean values 
obtained by the FP 24-hR compared well with those 
obtained by the WFR. Secondly, the Pearson and Spearman 
analysis showed high values of correlation coefficients, 
indicating good association between the two methods. 
Thirdly, the 95% limits of agreement showed acceptable 
values for the difference and, finally, Bland-Altman 
plots ensured the absence of systematic bias. 

The FP 24-hR is associated and in agreement with the 
WFR. The photographs are useful as memory aids for 
the volunteers during 24-h recall and as an estimation 
tool for the interviewer. The proposed method is suitable 
for assessing the dietary intake of rural populations in 
low-income countries, and it may have important impli- 
cations in clinical practice and research, representing a 
useful alternative to obtain accurate estimation of nutrient 
intakes. 
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